2023-11-21 09:08:57.AIbase.3.4k
Microsoft Launches ND H100v5 Virtual Machine Series Equipped with 8 NVIDIA H100 Chips
Microsoft has launched the new ND H100v5 virtual machine series, equipped with 8 NVIDIA H100 chips. The virtual machines feature AI supercomputing GPUs, next-generation CPUs, and low-latency networking. When using the new 8-bit FP8 floating-point data type for matrix multiplication operations, the speed has increased sixfold. ND H100v5 VM helps large language models achieve up to two times the inference speed improvement.
